Application Number 10/512,058 
Amendment dated December 19, 2007 
Office Action dated July 31, 2007 



Docket No.: 0033-0960PUS1 
Page 2 of 19 



AMENDMENT TO THE CLAIMS 

1. (Currently Amended) An image data generation apparatus comprising: 

reception means for receiving a parameter for displaying three-dimensional image data, 
said parameter including at least one of information data indicating a condition camera 
arrangement that has for picking picked up said an - three-dimensional image data , and at least 
one of information data indicating a method of generating three-dimensional image data from 
data of the picked up images and information data for controlling dispfev- presentation of the-said 
three-dimensional image data; 

three-dimensional image display control information generation means for generating 
three-dimensional image display control information by encoding said parameter; and 

file generation means for generating a multimedia information file based on both of said 
three-dimensional image display control information and said three-dimensional image data, or 
at least two-dimensional image data, wherein header control information is added thereto. 

2. (Original) The image data generation apparatus according to claim 1, further 
comprising recording means for recording said multimedia information file. 

3. (Original) The image data generation apparatus according to claim 1, wherein 

said file generation means outputs said multimedia information file to an external 
communication path. 

4. (Currently Amended) The image data generation apparatus according to claim 1, 
wherein 

said three-dimensional image display control information includes at least one of first 
information indicating a number of viewpoints of said three-dimensional image data, second 
information indicating from which viewpoint position said three-dimensional image data is 
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obtained, third information indicating a direction of sub-sampling of said three-dimensional 
image data, fourth information indicating arrangement of a camera that has picked up said three 
dimensional image data , fifih- fourth information indicating a maximum shift amount when a 
parallax image of said three-dimensional image data is shifted, sixth- fifth information indicating 
whether a border is to be displayed around an image of said three-dimensional image data, 
seventh -sixth information indicating border image data to be displayed around the image of said 
three-dimensional image data, and three-dimension identification information indicating that said 
multimedia information file contains the three-dimensional image data. 

5. (Canceled) 

6. (Currently amended) The image data generation apparatus according to claim 1, 
wherein 

said file generation means indicate a file type by p rovides p roviding a different extension 
to said multimedia information file between when said multimedia information file contains4he 
three-dimensional image data and when said multimedia information file does not contains-^ 
three-dimensional image data. 

7. (Currently amended) The image data generation apparatus according to claim 6, 
wherein 

when said extension indicates that said multimedia information file contains three- 
dimensional images data, said extension further indicates which of adapts to said plurality of 
different three-dimensional display methods , each display method being - and-4s-different from 
the other, for each of said plurality of three dimensional display methods is used to display said 
three-dimensional image data . 

8-9. (Canceled) 



MRC/JMA/cm 



Application Number 10/512,058 
Amendment dated December 19, 2007 
Office Action dated July 31, 2007 



Docket No.: 0033-0960PUS1 
Page 4 of 19 



10. (Currently Amended) An image data generation apparatus, comprising: 

a file generation unit for generating a multimedia information file including both of 
image pick-up condition information indicating an image pick-up condition for a three- 
dimensional image and three-dimensional image data, or at least two-dimensional image data, 
wherein header control information is added thereto, and 

wherein said both of image pick-up condition and three-dimensional image data, or at 
least two-dimensional image data are encoded in a parameter that is stored in said multimedia 
file, and 

wherein said image pick-up condition information includes at least one of information 
indicating a number of parallaxes in a horizontal direction and information indicating a number 
of parallaxes in a direction perpendicular thereto. 

1 1 . (Currently Amended) An image data generation apparatus, comprising: 

a file generation unit for generating a multimedia information file including both of 
image pick-up condition information indicating an image pick-up condition for a three- 
dimensional image and three-dimensional image data, or at least two-dimensional image data, 
wherein header control information is added thereto, 

wherein said both of image pick-up condition and three-dimensional image data, or at 
least two-dimensional image data are encoded in a parameter that is stored in said multimedia 
file, and 

wherein said image pick-up condition information includes at least one of information 
indicating a camera arrangement shape, information indicating an interval between adjacent 
cameras, and information indicating a distance from a camera arrangement plane to a 
convergence point. 
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12. (Currently Amended) An image data reproduction apparatus comprising: 

reception means for receiving a multimedia information file including both of three- 
dimensional image display control information generated by encoding a parameter for displaying 
three-dimensional image data and said three-dimensional image data, or at least two-dimensional 
image data,. 

wherein said parameter includes information data indicating a camera arrangement that 
has picked up said three-dimensional image data, and at least one of information data indicating 
a method of generating three-dimensional image data from data of the picked up image and 
information data for controlling presentation of the said three-dimensional image data; 

wherein header control information has been added to said multimedia 
information file ; 

file structure analysis means for analyzing a structure of said multimedia information file 
so as to extract the three-dimensional image display control information, the header control 
information and said three-dimensional image data or said two-dimensional image data; 

three-dimensional image display control information analysis means for analyzing said 
three-dimensional image display control informatio n extracted by said file structure analysis 
means ; 

data reproduction means for reproducing said three-dimensional image data extracted by 
said file structure analysis, b ased on the header control information extracted b v said file 
structure analysis means ; and 

data conversion means for converting said reproduced three-dimensional image data; 
data, such that said three-dimensional image data can be presented wherein said data con v ersion 
moans converts r -nid mprndntwl three dimonr.ional imago data for data for displa y in a display 
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unit, based on a result of analysis by said three-dimensional image display control information 
analysis means. 

13. (Currently amended) The image data reproduction apparatus according to claim 12, 
wherein 

said three-dimensional image display control information includes at least one of first 
information indicating a number of viewpoints of said three-dimensional image data, second 
information indicating from which viewpoint position said three-dimensional image data is 
obtained, third information indicating a direction of sub-sampling of said three-dimensional 
image data, fourth information indicating arrangement of a camera that has picked up said three 
dimensional image data , fife -fourth information indicating a maximum shift amount when a 
parallax image of said three-dimensional image data is shifted, sixth- fifth information indicating 
whether a border is to be displayed around an image of said three-dimensional image data, 
sevenfe -sixth information indicating border image data to be displayed around the image of said 
three-dimensional image data, and three-dimension identification information indicating that said 
multimedia information file contains the three-dimensional image data. 

14. (Currently amended) The image data reproduction apparatus according to claim 12 or 
13,_further comprising file type determination means for analyzing a structure of said multimedia 
information file so as to determine whether said multimedia information file includes at least one 
of three-dimensional image display control information is included; wherein 

said file type determination means determines whether said multimedia information file 
includes the and three-dimensional image data. 

15. (Currently amended) The image data reproduction apparatus according to claim 12 or 
13, further comprising file type determination means for analyzing a structure of said multimedia 
information file so as to determine whether three-dimension identification information is 
include d in said multimedia file ; wherei n and for further determining said file type determination 
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means determines at least one of w hether said multimedia information file includes fee-said 
three-dimensional image data or determines and on which three-dimensional display scheme said 
three-dimensional image data is based-en. 

16. (Currently Amended) An image data reproduction apparatus, comprising: 

reception means for receiving a multimedia information file including three-dimensional 
image display control information obtained by encoding a parameter for displaying three- 
dimensional image data and said three-dimensional image data, or two-dimensional image data, 
said parameter including at least one of information data indicating a condition camera 
arrangement that has for picking picked up said an- three-dimensional image data, and at least one 
of information data indicating a method of generating three-dimensional image data from data of 
the picked up image ? and information data for controlling disptev -presentation of the- said three- 
dimensional image data; and 

file type determination means for analyzing an extension of said multimedia information 
filet wherein said file type determination means determines , based on the analysis of said 
extension, at least one of w hether said multimedia information file includes said three- 
dimensional image data and or determines on which three dimensional display scheme said 
three-dimensional image data is based on, based on said extension . 

17. (Currently amended) The image data reproduction apparatus according to claim 16, 
wherein 

said three-dimensional image display control information includes at least one of first 
information indicating a number of viewpoints of said three-dimensional image data, second 
information indicating from which viewpoint position said three-dimensional image data is 
obtained, third information indicating a direction of sub-sampling of said three-dimensional 
image data, fourth information indicating arrangement of a camera that has picked up said three 
dim e nsional image data , fifth- fourth information indicating a maximum shift amount when a 
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parallax image of said three-dimensional image data is shifted, sixth- fifth information indicating 
whether a border is to be displayed around an image of said three-dimensional image data, 
seventh sixth information indicating border image data to be displayed around the image of said 
three-dimensional image data, and three-dimension identification information indicating that said 
multimedia information file contains the three-dimensional image data. 

18. (Currently Amended) An image data reproduction method, comprising: 

reproducing generating a multimedia information file including both of image pick-up 
condition information indicating an image pick-up condition for a three-dimensional image and 
three-dimensional image data, or at least two-dimensional image data, wherein 

said both of image pick-up condition and three-dimensional image data, or at least 
two-dimensional image data are encoded in a parameter that is stored in said multimedia file, and 
wherein 

said image pick-up condition information includes at least one of information 
indicating a number of parallaxes in a horizontal direction and information indicating a number 
of parallaxes in a direction perpendicular thereto; 

reproducing said three-dimensional image based on the image pick-up condition 
information indicating an image pick-up condition for a three-dimensional image and three- 
dimensional image data, or at least two-dimensional image data encoded in said parameter that is 
stored in said multimedia file . 

19. (Currently Amended) An image data reproduction method, comprising: 

reproducing generating a multimedia information file including both of image pick-up 
condition information indicating an image pick-up condition for a three-dimensional image and 
three-dimensional image data, or at least two-dimensional image data, wherein 
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said both of image pick-up condition and three-dimensional image data, or at least 
two-dimensional image data are encoded in a parameter that is stored in said multimedia file, and 
wherein 

said image pick-up condition information includes at least one of information 
indicating a camera arrangement shape, information indicating an interval between adjacent 
cameras, and information indicating a distance from a camera arrangement plane to a 
convergence point; 

reproducing said three-dimensional image based on the image pick-up condition 
information indicating an image pick-up condition for a three-dimensional image an d three- 
dimensional image data, or at least two-dimensional image data encoded in said parameter that is 
stored in said multimedia file . 

20. (Currently Amended) An image data recording medium, having stored thereon 
information representing a multimedia information file, the information when executed on an 
image data reproduction apparatus depicting information including both of three-dimensional 
image display control information generated by encoding a parameter for displaying three- 
dimensional image data and said three-dimensional image data, or at least two-dimensional 
image data, wherein 

header control information is added-feerete to said multimedia information file, and 

wherein said parameter includes information data indicating a camera arrangement that 
has picked up said three-dimensional image data, and at least one of information data indicating 
a method of generating three-dimensional image data from data of the picked up image and 
information data for controlling presentation of the said three-dimensional image data, and 

21. (Currently Amended) The image data recording medium according to claim 20, 
wherein the information when executed, further depicting said three-dimensional image display 
control information to include at least one of first information indicating a number of viewpoints 
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of said three-dimensional image data, second information indicating from which viewpoint 
position said three-dimensional image data is obtained, third information indicating a direction of 
sub-sampling of said three-dimensional image data, fourth information indicating arrangement of 
a camera that has picked up said three dimensional image data , fifth — fourth information 
indicating a maximum shift amount when a parallax image of said three-dimensional image data 
is shifted, sixth -fifth information indicating whether a border is to be displayed around an image 
of said three-dimensional image data, seventh sixth information indicating border image data to 
be displayed around the image of said three-dimensional image data, and three-dimension 
identification information indicating that said multimedia information file contains the three- 
dimensional image data. 

22. (Canceled) 

23. (Currently Amended) The image data recording medium according to claim 20 or 21, 
wherein the information when executed, further depicting said multimedia information file, with 
a different extension when said multimedia information file contains the-three-dimensional 
image data than when said multimedia information file does not contains-ae three-dimensional 
image data. 

24. (Currently Amended) The image data recording medium according to claim 23, 
wherein the information when executed, further depicting said extension to further indicate 
which of a adapting to a plurality of different three-dimensional display methods , each display 
method and-being different from the other, for each of said plurality of three dimensional display 
methods is used to display said three-dimensional image data . 

25. (Currently Amended) An image data recording medium, having stored thereon 
information representing a multimedia information file, the information when executed on an 
image data reproduction apparatus depicting information including both of image pick-up 
condition information indicating an image pick-up condition for a three-dimensional image and 
three-dimensional image data, or at least two-dimensional image data, wherein 
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wherein said both of image pick-up condition and three-dimensional image data, or at 
least two-dimensional image data are encoded in a parameter that is stored in said multimedia 
file, and 

said image pick-up condition information includes at least one of information indicating a 
number of parallaxes in a horizontal direction and information indicating a number of parallaxes 
in a direction perpendicular thereto. 

26. (Currently Amended) An image data recording medium, having stored thereon 
information representing a multimedia information file, the information when executed on an 
image data reproduction apparatus depicting information including both of image pick-up 
condition information indicating an image pick-up condition for a three-dimensional image and 
three-dimensional image data, or at least two-dimensional image data, wherein 

wherein said both of image pick-up condition and three-dimensional image data, or at 
least two-dimensional image data are encoded in a parameter that is stored in said multimedia 
file, and 

said image pick-up condition information includes at least one of information indicating a 
camera arrangement shape, information indicating an interval between adjacent cameras, and 
information indicating a distance from a camera arrangement plane to a convergence point. 

27-32. (Canceled) 

33. (Currently Amended) An image data recording medium, having stored thereon in a 
recording area, information representing a multimedia information file, the information when 
executed on an image data reproduction apparatus depicting information including both three 
dimensional image display control information generated by encoding a parameter for displaying 
three-dimensional image data and said three-dimensional image data, or at least two-dimensional 
image data, wherein 
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wherein said parameter includes information data indicating a camera arrangement that 
has picked up said three-dimensional image data, and at least one of information data indicating 
a method of generating three-dimensional image data from data of the picked up image and 
information data for controlling presentation of the said three-dimensional image data, and 
wherein 

said recording area further includes an image recording area for recording said three- 
dimensional image data or the two-dimensional image data, an audio recording area for 
recording audio data, and a sub code area for recording associated information including a time 
code. 

34. (Previously presented) The image data recording medium according to claim 33, the 
information when executed further depicting recording of at least a portion of said three- 
dimensional image display control information in said image recording area. 

35. (Previously presented) The image data recording medium according to claim 33, the 
information when executed further depicting recording of at least a portion of said three- 
dimensional image display control information in said audio recording area. 

36. (Previously presented) The image data recording medium according to claim 33 , the 
information when executed further depicting recording of at least a portion of said three- 
dimensional image display control information in said sub code area. 
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